SOFT's client located in New York, NY ( Hybrid ) is looking for a DevOps Cloud Engineer - Databricks / Starburst / Terraform for a long-term contract assignment.
PLEASE NOTE THE FOLLOWING BEOFRE APPLYING:
WE ARE NOT ACCEPTING ANY 3RD PARTY SOLICITATIONS FOR THIS OR ANY OF OUR JOB POSTINGS OR REQUSITIONS. ANY SUCH INQUIRIES WILL NOT BE CONSIDERED OR RESPONDED TO.
WE CAN ONLY WORK WITH DIRECT APPLICANTS WHO ARE AUTHORIZED TO WORK IN THE US WITHOUT SPONSORSHIP
THIS IS A HYBRID ROLE, REQUIRING 2 DAYS A WEEK AT THE CLIENT SITE IN LOWER MANHATTAN. THUS, ANY CANDIDATES MUST BE IN THE NY/NJ/CT TRI-STATE AREA AT THE TIME OF APPLICATION. CANDIDATES OUTSIDE OF THIS RADIUS WILL NOT BE CONSIDERED
Qualifications:
- 6-10 years of Cloud Infrastructure Engineering Experience with AWS
- Experience building and managing enterprise cloud infrastructure.
- Strong hands-on experience on AWS and/or Azure environments
- Strong hands-on experience with Infrastructure as Code (IaC) using Terraform, CloudFormation.
- Strong hands-on experience working with various AWS services including but not limited to IAM, EC2, S3, ELB/ALB, - RDS/Aurora, ElastiCache and serverless computing services
- Strong hands-on experience with Databricks and Starburst data platforms on AWS cloud.
- Demonstrated experience of ownership and responsibility for end-to-end design, development, testing, release of key components of data lake solution using Databricks and Starburst platforms.
- Demonstrated experience of developing, maintaining data lakes with advanced capabilities such as delta sharing capabilities
- Strong understanding of best practices in management of data, including master data, reference data, metadata, data quality and lineage.
- Proven experience in setting up DevOps infrastructure, CI/CD pipelines, driving automated build management using GitLab preferred.
- Extensive expertise in providing guidance, building highly available/fault-tolerant enterprise class infrastructure with multiple-region and multi-AZ models.
- Working knowledge of implementing cloud identity and access management solutions to enforce security guidelines.
- Working knowledge and experience with DevSecOps operating model
- Experience working in Agile teams.
- Development experience using Python and/or Java preferred.
- Proven experience translating architectural plans and business requirements into infrastructure implementations.
- Self-starter with the ability to effectively plan, prioritize and manage multiple projects, tasks and deliverables
throughout project lifecycle.
Responsibilities:
- 6-10 years of Cloud Infrastructure Engineering Experience with AWS
- Experience building and managing enterprise cloud infrastructure.
- Strong hands-on experience on AWS and/or Azure environments
- Strong hands-on experience with Infrastructure as Code (IaC) using Terraform, CloudFormation.
- Strong hands-on experience working with various AWS services including but not limited to IAM, EC2, S3, ELB/ALB, - RDS/Aurora, ElastiCache and serverless computing services
- Strong hands-on experience with Databricks and Starburst data platforms on AWS cloud.
- Demonstrated experience of ownership and responsibility for end-to-end design, development, testing, release of key components of data lake solution using Databricks and Starburst platforms.
- Demonstrated experience of developing, maintaining data lakes with advanced capabilities such as delta sharing capabilities
- Strong understanding of best practices in management of data, including master data, reference data, metadata, data quality and lineage.
- Proven experience in setting up DevOps infrastructure, CI/CD pipelines, driving automated build management using GitLab preferred.
- Extensive expertise in providing guidance, building highly available/fault-tolerant enterprise class infrastructure with multiple-region and multi-AZ models.
- Working knowledge of implementing cloud identity and access management solutions to enforce security guidelines.
- Working knowledge and experience with DevSecOps operating model
- Experience working in Agile teams.
- Development experience using Python and/or Java preferred.
- Proven experience translating architectural plans and business requirements into infrastructure implementations.
- Self-starter with the ability to effectively plan, prioritize and manage multiple projects, tasks and deliverables throughout project lifecycle.
